On the Structure of Solutions of Ergodic Type Bellman Equation Related to Risk-sensitive Control

نویسنده

  • Shuenn - Jyi Sheu
چکیده

Bellman equations of ergodic type related to risk-sensitive control are considered. We treat the case that the nonlinear term is positive quadratic form on first-order partial derivatives of solution, which includes linear exponential quadratic Gaussian control problem. In this paper we prove that the equation in general has multiple solutions. We shall specify the set of all the classical solutions and classify the solutions by a global behavior of the diffusion process associated with the given solution. The solution associated with ergodic diffusion process plays particular role. We shall also prove the uniqueness of such solution. Furthermore, the solution which gives us ergodicity is stable under perturbation of coefficients. Finally, we have a representation result for the solution corresponding to the ergodic diffusion.

برای دانلود رایگان متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

A nonlinear second order field equation – similarity solutions and relation to a Bellmann-type equation - Applications to Maxwellian Molecules

In this paper Lie’s formalism is applied to deduce classes of solutions of a nonlinear partial differential equation (nPDE) of second order with quadratic nonlinearity. The equation has the meaning of a field equation appearing in the formulation of kinetic models. Similarity solutions and transformations are given in a most general form derived to the first time in terms of reciprocal Jacobian...

متن کامل

Ergodic Control Problems for Optimal Stochastic Production Planning with Production Constraints

Abstract-we study the ergodic control problem related to stochastic production planning in a single product manufacturing system with production constraints. The existence of a solution to the corresponding Hamilton-Jacobi-Bellman equation and its properties are shown. Furthermore, the optimal control for the ergodic control problem and an example are given.@ 2000 Elsevier Science Ltd. All righ...

متن کامل

Small Parameter Limit for Ergodic, Discrete-Time, Partially Observed, Risk-Sensitive Control Problems

We show that discrete-time, partially observed, risk-sensitive control problems over an infinite time horizon converge, in the small noise limit, to deterministic dynamic games, in the sense of uniform convergence of the value function on compact subsets of its domain. We make use of new results concerning Large Deviations and existence of value functions.

متن کامل

A Constructive Approach to a Class of Ergodic HJB Equations with Unbounded and Nonsmooth Cost

We consider a class of ergodic Hamilton-Jacobi-Bellman (HJB) equations, related to large time asymptotics of non-smooth multiplicative functional of diffusion processes. Under suitable ergodicity assumptions on the underlying diffusion, we show existence of these asymptotics, and that they solve the related HJB equation in the viscosity sense.

متن کامل

Ergodic Control of Reflected Diffusions with Jumps

We discuss ergodicity properties of a controlled jumps diffusion process reflected from the boundary of a bounded domain. The control parameters act on the drift term and on a first order type jump density. The controlled process is generated via a Girsanov change of probability, and a long run average criterion is to be optimized. By means of the Hamilton-Jacobi-Bellman equation, an optimal st...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

عنوان ژورنال:

دوره   شماره 

صفحات  -

تاریخ انتشار 2006